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VideoJTtfmsmission 



The present invention is concerned with the transmission of digitally coded video signals 
over a telecommunications network, and, more particularly, video signals which have been 

5 encoded using a compression algorithm. 

The rationale of compression algorithms is to exploit the inherent redundancy of the 
original video signal so as to reduce the number of bits that require to be transmitted. 
Many such algorithms are denned in international standards such as the ITU H.263 and the 
ISO MPEG standards. A useful review of these is given in Ghanbari., M„ Video Coding, 

10 an introduction to standard codecs, IEE, London, 1999. 

The degree of redundancy naturally varies with the picture content, and consequently the 
compression efficiency does too, resulting in a varying number of coded bits per frame. 
One option is to transmit the bits as they are generated, as in so-called variable bit rate 
(VBR) systems in which the transmitted bit rate varies considerably with time. Another 

1 5 option - constant bit rate (CBR) systems - is to employ a buffer at both the transmitter and 
receiver, to smooth out these fluctuations, and transmit from the transmit buffer to the 
receive buffer at a constant rate. CBR systems utilise a feedback mechanism to vary the 
rate at which data are generated (for example by adjusting the coarseness of quantisation 
used, or frame dropping), to prevent buffer overflow. The use of buffering necessarily 

20 involves the introduction of delay, increasing the latency of start (LOS) - i.e. the user has 
to wait while the receive buffer is filled to the necessary level before decoding and display 
of the pictures can commence. The feedback mechanism involves reduction in picture 
quality. 

It has also been proposed to employ a degree of buffering to reduce, yet not totally 
25 eliminate, bit-rate variations (see, for example, Furini, M. and Towsley, D. F., "Real-Tune 
Traffic transmissions over the Internet", IEEE Transactions on Multimedia, Vol. 3, No. 1, 
March 2001). 

A major consideration when transmitting over a telecommunications network , and in 
particular packet networks such as the internet, is the effect of network congestion, where 
30 packet loss and unpredictable delays can cause problems. This has given rise to proposals 




for reservation systems, where a transmitter can request the network to allocate a specified 
guaranteed bit rate for its transmissions for a period of time. One such system, called 
"RSVP" is described in the Internet Engineering Task Force (IETF) document RFC 2205. 
However, other systems such as Expedited Forwarding of Differentiated Service, or CR- 
5 LDP may also be used. 

In the case of a live video feed, the future characteristics of the bitstream being coded are 
unknown; with recorded material, however, they are. The fact that reservation systems 
allow the amount of the reserved bit-rate to be changed offers the opportunity to decide on 
a policy of how much network capacity to reserve at any time, based on knowledge of the 

1 0 coded material. A simple approach is to calculate the peak (VBR, unbuffered) bit-rate and 
request this for the entire duration of the transmission, but this is wasteful of network 
capacity and of course the higher the capacity requested, the greater is the probability of 
the network being unable to provide it and hence of the reservation request being refused. 
Another simple approach, which minimises the bit-rate to be requested, is to calculate the 

1 5 average bit-rate of the whole transmission and request this; however this results in the need 
for a very large buffer at the receiver and, more importantly (given that large amounts of 
storage are today relatively cheap) a large LOS. A modification to the peak-rate approach 
is considered in the above-cited paper by Furini and Towsley. Their scheme involves 
identifying the point in the video sequence at which the peak rate reaches a maximum, and 

20 requesting this rate for the period of time up to that point. Then the maximum peak rate 
over the remainder of sequence is located, and this (lower) rate requested. This process 
continues in the same manner over the whole sequence. The paper also suggests that a 
degree of buffering might be applied, thereby reducing the effective peak rates before the 
reservation algorithm is applied. Although this system improves the efficiency of network 

25 use as compared with the single peak rate system, there is still much wasted (i.e. reserved 
but unused) network capacity, and of course the benefit is small if the maximum peak rate 
occurs towards the end of the sequence. It does however have the benefit that the amount 
of network capacity requested falls, and, specifically, a reservation request never asks for a 
bit-rate that exceeds that of the previous requests, thereby reducing the risk of the 

30 reservation request being refused. 
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According to the present invention there is provided a method of transmitting a digital 
sequence of video signals which have been encoded using a compression algorithm such 
that the number of coded bits per frame is not constant, comprising: 

(a) dividing the sequence into segments, wherein the first segment is a portion at the 
5 beginning of the sequence which has an average number of coded bits per frame which is 
greater than or equal to the average number of coded bits per frame of any shorter such 
portion, and wherein each succeeding segment is a portion immediately following the 
preceding segment which has an average number of coded bits per frame which is greater 
than or equal to the average number of coded bits per frame of any shorter such portion; 
10 (b) determining a bit rate for each segment; 

(c) transmitting the signals at the determined bit rates. 

Other aspects of the invention are set out in the sub-claims, below. 

Some embodiments of the invention will now be described, by way of example, with 

reference to the accompanying drawings, in which: 
1 5 Figures 1 A to 2C show graphically the results of tests carried out; 

Figure 4 is a block diagram of one form of apparatus for implementing the invention; and 

Figure 5 is a flowchart illustratiing the operation of the apparatus of Figure4. 

Consider, at a receiver, some arbitrary time segment (but equal to a whole number of frame 

periods), extending from time t s at which the receiver begins to decode frame g to time t h at 
20 which the receiver begins to decode frame h. The duration of this segment is h-g. 

Suppose, further, that the transmission rate during this segment is A bits/frame period. 

Obviously, at time t g , the receiver must have already received the bits for all frames up to 

and including frame g, i.e. 

±dj bits 

25 where dj is the number of coded bits generated by the encoder for frame./. 

Suppose however that the receiver has, prior to time g, also received;? additional bits, that 

is, in total, Zjdj+P bits. 




At any time t k (t g ^ t k < t h ) , at which the receiver begins to decode frame k, the receiver 
has also received (k - g)A bits, so: 

s 

Total bits received at time t k = ]T tf y +p + (k - g)A . 

At this point, the receiver needs to have all the bits for frames up to and including frame k 9 
5 that is: 

k 

Total bits needed at time h=^Tdj . 

Since the number of bits received must be at least equal to the number needed, the 
condition that needs to be satisfied to avoid buffer underflow is 

10 Or p + {k-g)A> J^dj 

If this is to be achieved without the transmission of preload bits p 9 this requires that 
(k-g)A>f i d J 

Thus, the transmitted rate A must be greater than or equal to the average generated bits per 
1 5 frame over frames g+1 to k 9 for any value of k (g + 1 ^ k < h) , which will be achieved if 



A = Max 



Use of this rate means that the number of bits./ft-gM transmitted during the segment will 
exceed the number of bits generated for the segment, unless the maximum occurs for k = h 9 
that is, at the end of the segment On the premise that the continued use of the 
20 tran s mission rate thus calculated, after the maximum has passed, seems to represent the use 



of a rate higher than absolutely necessary, the first version of the invention now to be 
describe aims to partition the data to be transmitted into segments in such a manner that 
these maxima always occur at the end of segment. 

The first method to be described is for the transmission of stored video material, already 
5 encoded using a compression algorithm such as MPEG, over a packet network such as the 
internet. It presupposes that the network has provision for reservation of bit-rate capacity. 
It aims to determine the bit-rate that is to be used as a function of time, in such a manner as 
to achieve: 

- small latency of start; 

10 - low transmitted bit-rate; and 

- high transmission efficiency (i.e. low wastage); 

although since these are conflicting requirements, any solution must necessarily be a 
compromise. 

In this example it is assumed that there is no constraint on the bit rate that may be chosen, 
1 5 and that the bit rate used for transmission and the bit rate reserved on the network are the 
same. 

This first version also is subject to the constraint that the requested bit-rate can never 
increase - i.e. it is a monotonically decreasing function of time: as noted above, this is 
desirable in reducing the risk of reservation failure. 

20 Since huge storage hardware is not a problem for current users, in this solution, reducing 
the required buffer size at the decoder is not of primary concern, though, in fact, the 
required buffer size resulting from this method is also greatly reduced compared with using 
the average bit rate to achieve VBR video transmission. Even in the worst case, rarely 
encountered in practice, the buffer size required would be no larger than required when 

25 transmitting a VBR video stream at the average bit rate. 

The following algorithm determines a "function of transmission ("FOT") to be used. 
We assume there are N frames in.the video sequence, and the number of encoded bits for 
each frame is do, di, d N _i , respectively 



o 




As noted above, this algorithm is subject to the constraint that the function of transmission 
can never increase, but only decrease. 

Conceptually, transmission rate changes can occur at any frame interval in the FOT. In 
practice, there may be a limit on how often the rate may be changed, depending on the 
5 constraints of the particular reservation system in use; however, with a monotonically 
decreasing FOT, a delay in rate change (although wasteful of network capacity), will not 
result in any loss of quality since its only effect is the reservation of more capacity than is 
actually needed. The first step of the algorithm is to find how many "steps" the FOT will 
have, and when each step occurs. 

1 0 First, we define: 

which represents the average bit rate of the video sequence from the start up to and 
including frame i. Then, Ao, A\ 9 . . .A^\ are calculated, and from these the value of/ 
having the largest Ai. Suppose this value is ko. The first "step" edge is defined as occurring 
15 at the end of frame ko. It means that, until the end of frame ko, FOT needs its highest 
transmission rate. 

After finding the first "step", frame (*b+l) is regarded as the "first" frame for the following 
frames and A i+ i W are calculated for i = Icq+1, Ab+2, ... 7V-1. The formula for this is 

20 or, in the general case, 

4°-7r*fh: CE.6B) 

Again, the largest value is chosen as the second "step" edge, at the end of frame k\ 9 h 
being the corresponding value of i . The above procedure is repeated until the last "step" 



edge at frame N-l has been reached. In general this results in M values k m , m = 0, ... M-l 
(where k MA is always equal to N-l) which may be regarded as dividing the video sequence 
into M-l segments: segment 0 comprises frames 0 to fa; other segments m each comprise 
frames ^-i+l to 

5 The purpose of the second stage of the algorithm is to choose an appropriate transmission 
rate for the "level" of each "step". Now, theoretically, the lowest rate that can ensure that 
all needed bits will be delivered by the end of each "step" even without any preloaded bits 
is the average of the bit-rates of the frames making up the segment. A lower rate 
necessarily requires preloaded bits and consequently a higher LOS, whilst with higher 

1 0 rates, network capacity may be wasted. Also, higher rates must lead to more risk of failure 
to reserve resource. 

There are M segments m = 0,l, ... M-l. Also, we define: 

Si is the sum of bits generated in Segment i - i.e. 2^d ? ; 

Ri is the transmission rate of FOT in Segment i ; (note that Ko=ko+l) 
15 Ki is the number of frames in Segment i - i.e. krh-i\ 

In this case the required rates are simply the average rates Ri = <S; / K t ; i = 1,2,.. M-l . 
This method can also be used to calculate the rate Ro for Segment 0, if we define *j - -1. 
Note that, in MPEG video coding, the first frame is always an I frame and it generates 
more bits than P or B frames. So, often, our results show the first segment includes only 
20 one frame and the transmission rate Ro is much larger than Rv Since users easily can wait 
a few frames' interval to have abetter chance of resource reservation success, we prefer to 
setRo = Ri- 

The Third Step: After we have determined the whole FOT, the required buffer size at the 
decoder can be worked. 
25 We now describe a second, modified version which is subject to a constraint on the rates 
that may be chosen. For example the constraint may be that the rate must be an integer 
number of bits per frame, or more generally that the rate must be one of a number of 
discrete rates. In analysis we will use the quantisation operators defined as follows: 



# • 

o. 4 

8 ^ 

Q + (X) means the lowest permitted rate greater than or equal to X (also referred to as the 
"ceiling" rate); 

Q"(X) means the highest permitted rate less than or equal to X (also referred to as the 
."floor" rate). 

5 Two options will be discussed: 

(a) rounding up to the ceiling rate: in this case the rate used can become higher than 
strictly necessary for a particular segment, which may offer the opportunity to use a 
lower rate for the following segment; 

(b) rounding down to the floor rate: in this case the rate used can become lower than 
1 0 necessary for a particular segment, resulting in the need to use a higher rate for the 

preceding segment. 

Consider first the ceiling option. We first define the ceiling value of the "height" of the 
first "step" in the original FOT as the "height" of the refined first "step" in our new FOT. 
It will be noticed that, in this way, after the first "step", more bits have been transmitted to 

1 5 the receiver than the sum of bits of frames belonging to the "first" step. Thus, when we 
refine the second "step", we should exclude the number of bit belonging to the following 
"step" but having been transmitted in the previous "step(s)" and recalculate the average 
rate of the second "step". If the ceiling value of the new average bit rate is not less than the 
ceiling value of the average rate of the old third "step", it is just defined it as the "height" 

20 of the refined second "step". Otherwise, we define the ceiling value of the average bit rate 
of the old third "step" as the "heighf 9 of the refined second "step". Follow this procedure 
until the "height" of the refined last "step" is fixed. Since it always takes the ceiling value 
of each "step", it is possible that the VBR video stream transmission is achieved a few 
frame intervals shorter than the duration of the video sequence. With simulating the 

25 transmission based on the new FOT, the lifetime duration of FOT can be exactly specified. 
Once the VBR video stream transmission is achieved, reserved network resource can be 
immediately released. Thus, the 100% bandwidth utilization is still guaranteed. With the 
height" of the refined first "step", LOS can be precisely recalculated. Finally, through 
simulating the transmission procedure, the required buffer size to prevent overflow can be 

30 also fixed. 



9 

The procedure adopted is as follows. Division into segments proceeds as before. 

As well as the quantities S h R h K h defined above, we also introduce R*i, sl temporary value 
for the transmission rate in Segment f. 

I. Calculate all the average rates R J t = Sf/Kf, 1 = 0,1, ... M-l. 

5 n. Set the rate for Segment 0 as Rq « Q + (R l o) 

(Note that if as discussed earlier it is desired to use a lower rate for the first Segment, then 
one may instead begin with Segment 1) 

HI. Set the rate for Segment 1 by subtracting, before quantisation, the extra bits sent during 
the previous Segment: 

R x =Q + {i? 1 1 -(i? 0 -i? 0 1 )} 
or = Q + {Rl] 

whichever is the greater. 

IV. For the remaining Segments i = 2, ... M-l : 

whichever is the greater. Naturally the second alternative does not arise for i = M-l. 

1 5 The third version to be described uses the "floor" rates. In this case, the processing must be 
performed in reverse order, starting from the last "step". This is necessary so that the bits 
which cannot be transmitted in a particular segment can be pre-transmitted in the previous 
Segments. The specific procedure first defines the floor value of the average bit rate of the 
last "step" as the new transmission rate of the refined last "step" in the new FOT. The 

20 number of bits which are needed by the refined last "step" but cannot be transmitted, can 
then be dete rmine d. The previous "step(s)" should guarantee such a number of extra bits 
transmitted before the new last "step" FOT starts. Thus, when we refine the penultimate 
"step", we must aim for it to carry the bits it needs itself, plus the extra number of bits 
needed by the last "step". So, a new average bit rate has to be re calculated for the second 

25 last "step". If the floor of the new average bit rate of the second last "step" is not bigger 
than the floor of the average rate of the third last "step" in original FOT, just define it as 



• • i 

10 ^ 

the "height" of the new second last "step". Otherwise, define the floor of the average bit 
rate of the old third last "step" as the "height" of the new second last "step". Following this 
procedure until the first "step", the refinement is achieved and the refined FOT is obtained. 
As in the ceiling case: with the number of the pre-fetched bits and the "height" of the 
refined first "step", LOS can be precisely recalculated; finally, through simulating the 
transmission procedure, the required buffer size to prevent overflow can be also fixed. 

As before, there are M segments m = 0,1, . . . MA. Also, we define: 




Ri is the transmission rate of FOT in Segment i ; 

Ki is the number of frames in Segment i - i.e. krKi\ 

R l i is a temporary transmission rate we assume in Segment i . 

I. Calculate all the average rates R l i -Si/K { ; i = 1,2,.. MA. 

II. . Set the transmission rate R M -\ for Segment MA equal to the floor value of the 
average rate for this segment. That is 

i?M-i=Q"{*Vi}. 

n. Compute the number of preloaded bits, P M -u that are needed to be present in the 
receiver buffer at the beginning of Segment M-l to prevent underflow in Segment M-l . 

m. The rate for the next segment can then be calculated as 

whichever is the lower, 
with 

Pm-2 = (R 1 m-2 - Rm-i) * Km-i 
IV. This process is then repeated using the general formula, m= M-3, ... ,0: 
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whichever is the lower. 
And 

Pm = ^ w™ Rm. 

5 Again, if desired this iteration may be stopped at m = 1 and R\ used for Segment 0. 

This process results in a value for P 0 which is a preload for the first Segment, and will need 
to be transmitted first. In fact, it is convenient to define a preload bo which includes all bits 
that are transmitted before the receiver starts decoding the first frame at *=0. 

Assuming that Ro is calculated as above, than 

10 ^0 = ^0 + ^0 

If, however the rate R\ is used for Segment 0, then only (K 0 - l)Ri bits can be transmitted 
between *=0 and the end of the segment and therefore the total preload is: 

^+^-(^0-1)^ 

The latency of start (LOS) is, assuming R\ is used, b Q /R x . 

1 5 The question of buffer size will now be discussed. Certainly, with our FOT, we can get 
reasonable transmission rate and LOS. The network transmission efficiency can be almost 
100%, and it requires a smaller buffer size than the directly using fixed average rate 
bandwidth. However, in some situations, it is still much bigger than it required by 
reserving the peak rate bandwidth. In the scheme of reserving the peak rate bandwidth, it is 

20 enough if the buffer size at the decoder is only as much as the number of bits spent on the 
most complicated frame. However, in our scheme, we do need a larger buffer than that. 
Although, compared with a constant average bit rate, our scheme can get a much smaller 
buffer size in most of the situations, it should be admitted that, in the worst situation, the 
buffer size required by our scheme is near the buffer size required by a constant average bit 

25 rate. Such a situation happens when the biggest Ai appears in the last frames of the video 
sequence. In such a situation, our "down stairs" curve almost has only one "step". Thus, it 
would be not effective enough to minimise the buffer size through the "step" changes. 
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Nevertheless, such a situation hardly appears because, the later the "peak bits" appears, the 
less effect on A*. Unless, at the end of the sequence, quite a few exceptional complicated 
frames appear abnormally, it will never happen. No matter what situation happens, LOS 
will never be a problem with our scheme. We believe, currently, it should not be a problem 
5 for the user to have some hardware that has a little large storage. A small LOS and good 
network transmission efficiency should cause more concern by the users. 

In addition, even if users cannot afford a large buffer size our scheme requires, a 
compromise may be taken between the transmission efficiency and required buffer size at 
the decoder. With such a compromise, the required buffer size can be further reduced as 
1 0 the users wish. A new algorithm that severs such a compromise will be designed in our 
future work. 

Incidentally, although our current algorithm description is only based on bits per frame as a 
basic unit, naturally, the unit can be denned as a GOP or certain number of pictures or 
packets together. No matter what unit we would like to define in this algorithm, the 
1 5 principle is general and should be in common. 

We now describe some examples of coding test video sequences, using the "floor" method. 
In each case the values of the function of transmission f(t) (or Rj), the value of b 0 , and a 
suggested rate for transmission of b 0 are given, (a) for the above algorithm (b) using the 
method of Furini and Towsley, and (c) using a single, average bit rate. 

20 Example 1 "JacknBox" 

(a) We have coded a test sequence (named Jacknbox) of common intermediate format 
(CIF), 140 frames in duration with a fixed quantiser of step size 16 using H.263+ and 
derived the FOT function with our algorithm. 
f(t) = 

25 5100 0<t<=T 48 ; 

3645 T 48 <t<=T 5 i; 

3058 T 5 i<t<=T 52 ; 

2830 T 52 <t<=T 6 i; 

2682 T 6 i<t<=T 70 ; 
30 2651 T 7 o<t<=T 7 i; 
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2464 T 7 i<t<=T 90 ; 
2447 T9o<t<=Ti 08 ; 
2321 Tios<t. 

In this document, we define T { as the time when the decoder displays Frame i. 
5 We define the measure unit of all measurement rates in this document as bits per frame 
interval. 

b 0 = 39824 bits ; suggested transmission rate for b 0: 5 1 OObits per frame interval 

(b) Using Furini and Towsley's method, we get 
f(t) = 



9896 


To<t<=T 29 ; 


9432 


T 2 9<t<=T 4 o; 


7272 


T40 < t <= T41 ; 


6552 


T 4 i<t<=T 46 ; 


6184 


T 4 6<t<=T 47 ; 


•5328 


T 47 <t<=T 48 ; 


3696 


T 48 <t<=T 5 i; 


3632 


T 5 i<t<=Tio6; 


3552 


Tio6<t<=Ti 38 ; 


2896 


Tl38<t. 



20 b 0 = 39824 bits 

In their transmission scheme, b 0 would be achieved by 39824 bits per frame interval, 
(c) With a constant average bit rate, the function would be: 
f(t) = 3669. 
b 0 = 108488 bits; 
25 b 0 is achieved by 3669bits per frame interval. 
Figure 1 shows these results plotted graphically. 



o 
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The analysis results are listed in Table 1 : 



Schemes 


(c) Fixed 
bandwidth 
channel with 
average bit rate 


(a) Our scheme 


(b) Furini & 
Towsley 


Bandwidth 
utilization (%) 


100 


100 


63.46 


The Start 
Reservation Rate 
(bits/per frame 
interval) 


3,669 


5,100 


39,824 


LOS(frames) 


108488/3669 = 
29.57 


39824/5100=7.8 


39824/39824 = 1 


Buffer Size(bits) 


108,488 


60,336 


39,824 



Table 1: JacknBox 140 frame, BL263+ 

We have also encoded the same video sequence with a CBR rate control. In this case, the 
LOS would be 29656/3735 = 7.94 frames. However, 10 frames are skipped with the 
5 normal CBR rate control and the bits budget we give is the same as the average number of 
bits in VBR encoding. 

Example 2. 8400 frames' TV Programme using H.263+: 

This test used a normal TV programme QCIF (quarter-CIF) sequence with 8400 frames, 
coded with a fixed Quantiser step size of 16 using H.263+. The picture type is IPPPP.... 
1 0 with forced updating every 132 frames in the H.263+ recommendation. 

(a) £(t) = 

T 0 <t<=T 3 i73; 

T3173 < t<=T3679 J 

T3679 < t <= T3680 ; 
T3680 < t <= T3681 ; 

T368I < t <=T4752 ; 
T4752 < t <= T8392 J 



4977 
4218 
3968 
15 3848 
3844 
3090 




15 

992 T 83 !>2<t<=T 8 393 ; 

816 Ts393 < t <= Ts394 

644 T 839 4 <t <=T 8 396 i 

544 T 83 96 <t< = T 8 397 ; 

5 384 t>T 83 97 ; 

b 0 = 13944 bits; 

As previously, bo may be achieved by the first rate of 4977 bits per frame interval. 





(b) f(x) = 














27672 


T 0 <t<=T 8 33 9 ; 


21952 T 83 58 <t< = 


T 8 359 ; 


10 


26704 


T 8 339 < t < = 


T 8 340 ; 


21744 T 835 9 <t< = 


T 8 369 ; 




26560 


T 8 340 < t < = 


T 8 34i ; 


20448 T 83 69 <t< = 


T 8 373 ; 




26488 


T 83 41 < t < = 


T 8 342 ; 


20344 T 837 3 <t< = 


T 8 3 8 4 ; 




26240 


T 8 342 < t < = 


T 8 344 ; 


19960 T 8384 <t< = 


T 8 3 8 5 ; 




25832 


T 83 44<t< = 


T 8 345 ; 


19016 T 8385 <t< = 


T 8 39i; 


15 


25136 


T 834 5 <t< = 


T 8 346 ; 


11656 


T 8 391 < t < = 


T 8 392 ; 




24168 


T 83 46 <t< = 


t 8 347 ; 


992 


T 8 392 < t < = 


T 8 393 ; 




23816 


T 83 47 <t< = 


T 8 352 ; 


816 


T 8 393 < t < = 


T 8 394 ; 




23760 


T 835 2 <t < = 


= T 8 353 ; 


648 


T 8 394 < t < = 


T 8 396 ; 




23616 


T 8353 <t< = 


T 8 356 ; 


544 


T 8 396 < t < = 


T 8 397 ; 


20 


22824 


T 835 6 <t< = 


T 8 357 ; 


384 


T 8 397 < t < = 


T 8 399- 




22528 


T 83 57 <t< = 


t 8 358 ; 









b 0 =13944 bits; 

bo may be transmitted at 29762 bits per frame interval. 

(c) With a constant average bit rate, FOT would be: 

f(t) = 3966. 

b 0 = 3348584 bits; 

bo may be set at 3669bits per frame interval. 



o 
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Figure 2 shows these FOT curves for 8400 frames' TV pro, 
The analysis results are listed in Table 2: 



gramme withH.263+. 



Schemes 


(c) Fixed bandwidth 
channel with average 
bit rate 


(a) Our 
scheme 


(b) Furini & 
Towsley 


Bandwidth utilization 
(%) 


100 


100 


14.36 


The Start Reservation 
Rate (bits/per frame 
interval) 


3,966 


4,977 


27,672 


LOS (frame interval) 


3348584/3966 
844.322 


13944/4977 
= 2.8 


13944/27672 - 0.5 


Buffer Size (bits) 


6,116,362 


3,908,218 


27,672 



Table 2:8400 frames H.263+ 
5 Example 3 . 8400 frames' TV QCIF Programme coded with MPEG4: 

The same TV programme QCIF sequence of 8400 frames was coded using MPEG4, 
with a fixed Quantiser step size of 10. The picture type is IBBPBBPBBPBB (N=12, M=3). 
It should be noted that, with B pictures, the encoding sequence of pictures is different from 
the displaying sequence of pictures. So the related I or P pictures must be transmitted prior 
10 to the B picture. Some pre-processing is needed before using our algorithm. 

(a) Finally, our FOT is: 

7426 T 0 <t<=T 47 5o; 

6938 T 47 50<t < = T 478 6 ; 

1 5 66470 T 47 86 < t < = T 47 98 ; 

6309 T 4 798 <t< = T 48 7o; 

6190 T 487 o<t< = T 4 90o; 

6083 T 49 oo<t< = T 49 i8; 
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6026 



168 



T4913 < t < = T8398 ', 
Tg398 < t 



b 0 = 16548 bits; 
5 bo can be sent using 7426 bits per frame interval. 



(b) fix) = 




57472 


To < t < =Tg338 ; 


50616 


T8338 < t < = T8350 


49504 


T8350 < t < = T8368 I 


48608 


T8368 < t < = T8371 


48536 


T8371 < t < = Ts383 ; 


44968 


T8383 < t < = Ts386 


31752 


Ts386 < t < = T8389 ; 


28696 


T8389 < t < = T8398 ', 


•168 


T8398 < t. 



b 0 - 16040 bits; 

bo may be set at 57472 bits per frame interval, 
(c) With a constant average bit rate, FOT would be: 
fix) = 6825. 
20 b 0 = 2874758 bits; 

bo may be set at 6825 bits per frame interval. 

Figure 3 shows these FOT curves for 8400 frames' TV programme with MPEG4 (N=12, 
M = 3). 

The analysis results are listed in Table 3: 
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Schemes 


(c) Fixed 
bandwidth channel 
with average bit 
rate ' 


(a) Our 
scheme 


(b) Furini & 
Towsley 


Bandwidth utilization 

(%) 


100 


100 


11.897 


The Start Reservation 
Rate (bits/per frame 
interval) 


6,825 


7,426 


57,472 


LOS (frames) 


2874758/6825 
421.21 


16548/7426 
= 2.228 


16040/57472 
0.279 


Buffer Size (bits) 


6,236,252 


3,997,072 


57,472 



Table 3: 8400 frames, MPEG4 

From the above experimental results, it can be seen that LOS has been greatly reduced 
while we still keep 100% transmission efficiency. No network resource has been wasted. 
The only thing still can be further improved is to further minimise the required buffer size 
5 at the decoder. 

Figure 4 is a block diagram of a server operable in accordance with the invention. It 
contains the usual computer components, that is a processor 10, memory 11, a disc store 
12, keyboard 13, a display 14, and a network interface 15 for connection to a 
telecommunications network 16. Video sequences available to be transmitted are stored in 
1 0 the disc storel2 in a conventional manner in the form of encoded files 20. 

Also stored in the disc store 12 is a computer program 21 for implementing controlling the 
operation of the server. The operation of this program, using the "floor" method, will now 
be described with reference to the flowchart shown in Figure 5. 

Step 100 

15 A request is received via the interface 15 from a remote terminal for transmission of a 
desired video sequence; such a request includes the filename of that one of the files 20 
containing that sequence. 

Step 101 



* 
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The processor 10 reads the file in question from the disc store 12 and determines the 
number of coded bits dj in the file for each of the N frames in the stored sequence, and 
stores the value of N and dj Q « 0...N - 1) in the memory 11. 

Step 102 

5 The processor calculates ko-..JcM-i as described above and stores M and ko...kM-i in the 
memory 11. 





Step 103 


Calculate R J t = for all i 




Step 104 


Set Rm-i = e-{ R, M-i} and Compute P M -\ 




Step 106 


Set a pointer m = M-2 


10 


Step 107 


Compute R m and P m 




Step 109 


Decrement m. If m > 0 , go to step 107 




Step 111 


Compute b 0 = Pq + Ro 




Step 112 


Compute the segment durations - in this implementation the preload and 




segment 0 are regarded as a single segment for transmission purposes. Thus 


15 




=(bjR 0 + k 0 +l)*T 






={ki-k { _ t )*T i=\...M-\ 




where x is the length of a frame period. 




Step 113 


Set i to 0 




Step 114 


Transmit a reservation request specifying a rate of R { and a duration of at 


20 


least X{. 






Step 115 


Transmit Segment i at rate R t (preceded, when i = 0, by P 0 preload bits). 



Step 116. If all segments have been transmitted, stop; otherwise, increment i at 117 
and go to step 114. 

Some reservation systems, such as the RSVP system mentioned earlier, in order to 
25 accommodate multicasting, require that a reservation request be issued by the receiving 
terminal. In such a case step 113 would be modified to specify the transmission of a 
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message to the receiving terminal specifying Rj and Ti- Whereupon the te rmin al would 
transmit the required reservation request to the network. 

In some networks, it may be that there is some constraint on the times at which the 
reserved rate may be changed. However the approach adopted above is robust to such 
5 problems because every reservation request except the first requests a lower rate than 
before. It follows that delay in processing such requests results in the reserved rate 
remaining high after the actual transmitting rate has been reduced. In this case the 
efficiency of network utilisation falls, but the transmission quality is unaffected. 
The reservation algorithm described above is built upon the constraint that the reserved bit 
1 0 rate must never be increased. This is not however essential, so a second embodiment of 
the invention which is not subject to this constraint will now be described. 

In the case, each segment is chosen in such a manner that, as before, the average generated 
bit rate for the segment is greater than or equal to the average for any shorter part of 

the video sequence beginning at the start of that segment, but, now, may be less than the 
1 5 average for some longer part starting at the same point. 

The procedure will be described for the general segment q (= 0. . .MA) 
Using 

Art _ 

calculate Afi> for all + 1 < i < k q ^ + H (or k q _ x +.1 -1 if this is shorter) 

20 where H is some defined maximum length that is to be permitted. 

Find the value of / for which is largest, and set k q equal to this value of/. 

This is the same as the previously described procedure, except that the search for the 
maximum average rate is restricted in its range. 

Once kq ( q = 0,...,M-1) have been determined, the actual transmission rates can be 
25 determined exactly as described above except that any limits defined to prevent a rate from 




exceeding that of the preceding segment, or from falling below that of the following one, 
are omitted. 




1. A method of transmitting a digital sequence of video signals which have been 
encoded using a compression algorithm such that the number of coded bits per frame is not 

5 constant, comprising: 

(a) dividing the sequence into segments, wherein the first segment is a portion at the 
beginning of the sequence which has an average number of coded bits per frame which is 
greater than or equal to the average number of coded bits per frame of any shorter such 
portion, and wherein each succeeding segment is a portion immediately following the 

1 0 preceding segment which has an average number of coded bits per frame which is greater 
than or equal to the average number of coded bits per frame of any shorter such portion; 

(b) dete rmining a bit rate for each segment; 

(c) transmitting the signals at the determined bit rates. 

15 

2. . A method according to claim 1 wherein the first segment is that portion at the 
beginning of the sequence which has an average number of coded bits per frame which is 
greater than or equal to the average number of coded bits per frame of any possible such 
portion, and wherein each succeeding segment is that portion immediately following the 

20 preceding segment which has an average number of coded bits per frame which is greater 
than or equal to the average number of coded bits per frame of any possible such portion. 

3. .A- method according to. claim .1 wherein the first segment is that, portion, at the.. 
25 beginning of the sequence which has an average number of coded bits per frame which is 

greater than or equal to the average number of coded bits per frame of any possible such 
portion not exceeding a maximum predetermined length, and wherein and each succeeding 
segment is that portion immediately following the preceding segment which has an average 
number of coded bits per frame which is greater than or equal to the average number of 
30 coded bits per frame of any possible such portion not exceeding said maximum 
predetermined length. 
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4. A method according to claim 1,2 or 3 in which the bit rate determined for each of 
at least the later segments of the sequence is a number of bits per frame period equal to the 
average coded bits per frame for that segment. 



5. A method according to claim 1,2 or 3 in which the bit rate determined for each of 
at least the later segments of the sequence is a number of bits per frame period equal to the 
lowest one of a set of permitted bit rates that is greater than or equal to a nominal rate for 
10 that segment, said nominal rate being the average coded bits per frame for that segment 
less any reduction permitted as a consequence of the determined bit rate for the preceding 
sequence being in excess of the nominal rate for that preceding segment. 



15 6. Amemodaccordmgtoclahnl,2or3mwMchmebitratedeternfrnedforeachof 
at least the later segments of the sequence is a number of bits per frame period equal to the 
highest one of a set of permitted bit rates that is less than or equal to a nominal rate for that 
segment, said nominal rate being the average coded bits per frame for that segment plus 
any increase necessitated as a consequence of the determined bit rate for the following 

20 sequence being less than the nominal rate for that preceding segment. 



7. A method according to claim 2 in which the bit rate determined for each of at least 
the later segments of the sequence is a number of bits per frame period equal to the larger 
25 of: 

(i) the lowest one of a set of permitted bit rates that is greater than or equal to a nominal 
rate for that segment, said nominal rate being the average coded bits per frame for that 
segment less any reduction permitted as a consequence of the determined bit rate for the 
preceding sequence being in excess of the nominal rate for that preceding segment; and 
30 (ii) the lowest one of the set of permitted bit rates that is greater than or equal to the 
average coded bits per frame for the following segment. 




8. A method according to claim 2 in which the bit rate determined for each of at least 
the later segments of the sequence is a number of bits per frame period equal to the lower 
of: 

5 (i) the highest one of a set of permitted bit rates that is less than or equal to a nominal rate 
for that segment, said nominal rate being the average coded bits per frame for that segment 
plus any increase necessitated as a consequence of the determined bit rate for the following 
sequence being less than the nominal rate for that preceding segment; and 
(ii) the highest one of the set of permitted bit rates that is less than or equal to the average 
1 0 coded bits per frame for the preceding segment. 
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9. A method according to any one of the preceding claims, including transmitting to 
a telecommunications network commands requesting reservation of said determined bit 
rates. 
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